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SIGNAL ADAPTIVE FILTERING METHOD, 
SIGNAL ADAPTIVE FILTER AND COMPUTER READABLE MEDIUM 
FOR STORING PROGRAM THEREFOR 

, 5 

Technical Field 

The present invention relates to data filtering, and more particularly, to a 
signal adaptive filtering method for reducing blocking effect and ringing noise, a 
signal adaptive filter and a computer readable medium for storing a program 
10 therefor. 

Background Art 

Generally, picture encoding standards such as MPEG of the International 
Standardization Organization (ISO) and H.263 recommended by the International 

15 Telecommunication Union (ITU) adopt block-based motion estimation and discrete 
cosine transform (DCT) blocks. When an image is highly compressed, the block- 
based coding may cause the well-known blocking effect. A typical blocking effect 
is grid noise in a homogeneous area in which adjacent pixels have relatively similar 
pixel values. Another blocking effect is staircase noise which has a staircase shape 

20 and is generated along the edges of the image. Also, ringing noise is a typical 
Gibb's phenomenon occurring by truncation when the coefficients of the DCT are 
quantized so as to highly compress the image. 

Grid noise shows traces of the block-based process at the edges between 
blocks when the compressed data is displayed on a screen after being restored. 

25 Thus, one can identify the edges between blocks. Also, staircase noise has a 
staircase shape at the edges of the image, so that one can notice a bumpy edge on 
the image. Also, one can notice overlapping of images with a predetermined 
interval due to the ringing noise. 

In order to reduce the blocking effect and the ringing noise occurring when 

30 block-based coding is performed, several methods have been suggested. According 
to H. 261 encoding, a simple 3x3 low-pass filter (LPF) is used as a loop filter to 
reduce the blocking effect [ w Video Codec for Audiovisual Services at Px62 kbit/s* \ 
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CCITT Recommendation H.261, December 14, 1990J. Also, a simple edge loop 
filter has been suggested so as to reduce the blocking effect and mosquito noise 
[G.Bjontegaard, "A Simple Edge Loop Filter to Reduce Blocking and Mosquito 
Noise", ISO/IEC JTC 1 /Sc29AV Gil MPEG96/0617, January, 1996, and "A Simple 
Edge Loop Filter to Reduce Blocking and Mosquito Noise" , ITU SC15 LBC Expert 
Group ITU-LBC-96-032, January, 1996]. The edge loop filter makes linear values 
of two pixels adjacent to the block boundary and replaces the two pixel values by 
the linearized values. Such edge loop filter can reduce the blocking effect but not 
the ringing noise. In order to reduce the ringing noise, a non-linear filter using a 
binary index has been suggested [Y.Itoh, "Detail Preserving Nonlinear Filter using 
Binary Index, "ISO/IEC JTC1/SC29/WG11 MPEG95/0357, November, 1995]. 
However, the non-linear filter cannot reduce the blocking effect. 

Disclosure of the Invention 

To solve the above problems, it is an object of the present invention is to 
provide an signal adaptive filtering method for reducing blocking effect and ringing 
noise in high compression encoding, a signal adaptive filter, and a computer 
readable medium. 

According to an aspect of the present invention, there is provided a signal 
adaptive filtering method capable of reducing blocking effect and ringing noise of 
image data when a frame is composed of blocks of a predetermined size, the 
method comprising the steps of: (a) generating blocking information for reducing 
the blocking effect and ringing information for reducing the ringing noise, from 
coefficients of predetermined pixels of the upper and left boundary regions of the 
25 data block when a frame obtained by deconstructing a bitstream image data for 
inverse quantization is an intraframe; and (b) adaptively filtering the image data 
passed through inverse quantization and inverse discrete cosine transform according 
to the generated blocking information and ringing information. 

Preferably, the step (a) further comprises the step of setting the blocking 
information and ringing information of the previous frame corresponding to a 
motion vector as blocking information and ringing information of the current frame 
if the frame is an interframe, and setting the ringing information to "1" which 



20 



30 



3 

represents the image data requiring filtering if a residual signal of the inverse- 
quantized current block exists, and the blocking information and ringing 
information are determined according to coefficients of a pixel A located at the 
upper left corner of the block, a pixel B located to the right of the pixel A and a 
5 pixel C located below the pixel A. 

Preferably, the blocking information is constituted of horizontal blocking 
information and vertical blocking information, and the horizontal blocking 
information is set to "1" which means the image data requiring filtering when only 
the coefficient of the pixel A is not equal to "0" or any coefficient of the pixels of 

10 the left boundary region of the block is not equal to "0", and the vertical blocking 
information is set to "I" which means the image data requiring filtering when only 
the coefficient of the pixel A is not equal to "0" or any coefficient of the pixels of 
the upper boundary region of the block is not equal to "0", and the ringing 
information is set to M l" which means the image data requiring filtering when any 

15 coefficient of the pixels other than the pixels A, B and C of the block is not equal 
to "0". 

Preferably, the blocking information is constituted of horizontal blocking 
information and vertical blocking information, and the horizontal blocking 
information is set to n V which means the image data requiring filtering when all 

20 coefficients of the pixels A, B and C of the block are not equal to "0 W or any 
coefficient of the pixels of the left boundary region of the block is not equal to "0" , 
and the vertical blocking information is set to w l tt which means the image data 
requiring filtering when all coefficients of the pixels A, B and C are not equal to 
M 0" or any coefficient of the pixels of the upper boundary region of the block is not 

25 equal to "0 W , and the ringing information is set to "1" which means the image data 
requiring filtering when any coefficient of the pixels other than the pixels A, B and 
C of the block is not equal to "0". 

Preferably, in order to reduce the blocking effect, in the step (b), the 
horizontal (or vertical) filtering is performed using a weighted filter having a 

30 predetermined weighted value when the horizontal (or vertical) blocking 
information of the block is equal to "1" and the ringing information is equal to w 0\ 
and when the horizontal (or vertical) blocking information of the block is not equal 



to "1" or the ringing information is not equal to "0", an absolute value of the 
difference between adjacent pixels and a Q value used as a dividend for quantizing 
the block are compared, and then filtering is performed with a predetermined value 
according to the result of the comparison. 

According to another aspect of the present invention, there is provided a 
signal adaptive filter capable of reducing blocking effect and ringing noise of image 
data when a frame is composed of blocks of a predetermined size, comprising: a 
mode flag checking unit for checking a flag to determine whether or not a frame 
is an intraframe or an interframe when a bitstream image data is deconstructed for 
inverse quantization; an intra filtering information generator for generating blocking 
information for reducing the blocking effect and ringing information for reducing 
the ringing noise, from coefficients of predetermined pixels of the upper and left 
boundary regions of the data block when the frame is determined as an intraframe 
by the mode flag checking unit; an inter filtering information generator for setting 
the blocking information and ringing information of the previous frame 
corresponding to a motion vector as blocking information and ringing information 
of the current frame if the frame is an interframe, and setting the ringing 
information to "1 M if a residual signal of the inverse-quantized current block exists; 
and an adaptive filter for adaptively filtering the image data passed through an 
inverse quantizer and an inverse discrete cosine transformer according to the 
blocking information and the ringing information generated by the intra filtering 
information generator and the inter filtering information generator. 

The invention may be embodied in a general purpose digital computer that 
is running a program from a computer usable medium, including but not limited to 
storage media such as magnetic storage media (e.g., ROM's, floppy disks, hard 
disks, etc.), optically readable media (e.g., CD-ROMs, DVDs, etc.) and carrier 
waves (e.g., transmissions over the Internet). Hence, the present invention may 
be embodied as a computer usable medium. 

According to still another aspect of the present invention, there is provided 
a computer readable medium having embodied thereon a computer program for a 
signal adaptive filtering capable of reducing blocking effect and ringing noise of 
image data when a frame is composed of blocks of a predetermined size, wherein 



the signal adaptive filtering comprises the steps of: (a) generating blocking 
information for reducing the blocking effect and ringing information for reducing 
the ringing noise, from coefficients of predetermined pixels of the upper and left 
boundary regions of the data block when a frame obtained by deconstructing a 
5 bitstream image data for inverse quantization is an intraframe; (b) setting the 
blocking information and ringing information of the previous frame corresponding 
to a motion vector as blocking information and ringing information of the current 
frame if the frame is an interframe, and setting the ringing information to "1" 
which represents the image data requiring filtering if a residual signal of the 
10 inverse-quantized current block exists; and (c) adaptively filtering the image data 
passed through the inverse quantization and inverse discrete cosine transform based 
on the block according to the generated blocking information and ringing 
information. 

Also, there is provided a computer readable medium having embodied 
15 thereon a computer program for a method of filtering ringing noise caused when 
decoding a block-based compressed image data, wherein the ringing noise filtering 
method comprises the steps of: (a) performing a gradient operation on the block 
subjected to inverse quantization and inverse discrete cosine transform using 
predetermined one-dimensional horizontal and vertical gradient operators; (b) 
20 generating a binary edge map representing whether or not each pixel is an edge 
pixel, using an absolute value of the difference between the gradient-operated value 
of one pixel and the value of the adjacent pixel, and a Q value used as a dividend 
for quantizing the block; and (c) performing a filtering by applying a predetermined 
filter window to the generated binary edge map. 

25 

Brief Description of the Drawings 

FIG. 1 is a block diagram of a signal adaptive filter for reducing blocking 
effect and ringing noise according to the present invention; 

FIG. 2 is a flowchart illustrating a signal adaptive filtering method according 
30 to a preferred embodiment of the present invention; 

FIG. 3 shows an inverse-quantized block having 8x8 pixels; 

FIG. 4 is a flowchart illustrating the step of generating information used to 



filter an intraframe; 

FIG. 5 is a flowchart illustrating the step of generating information used to 
filter an interframe; 

FIG. 6 shows the location of pixels adjacent to the block boundary for 
5 illustrating the filtering for reducing blocking effect; and 

FIG. 7 shows the location of pixels to be processed in the current block. 

Best mode for carrying out the Invention 

In FIG. 1, a signal adaptive filter for reducing blocking effect and ringing 
10 noise according to the present invention includes a mode flag checking unit 120, 
an intra filtering information generator 130, an inter filtering information generator 
140 and an adaptive filter unit 150. When bitstream image data is deconstructed 
for inverse quantization, the mode flag checking unit 120 checks whether or not the 
frame is an intra frame or an inter frame. The intra filtering information generator 

15 130 generates blocking information for reducing blocking effect and ringing 
information from coefficients of predetermined pixels of the upper and left 
boundary regions of the data block when the frame is determined as an intra frame 
by the mode flag checking unit 120. When the mode flag checking unit 120 
determines the frame as an inter frame, the inter filtering information generator 140 

20 generates blocking information and ringing information of the previous frame 
corresponding to a motion vector as blocking information and ringing information 
of the current frame. If a residual signal of the inverse-quantized current block 
exists, the ringing information is set to "1". The adaptive filtering unit 150 
adaptively filters the image data of the block which has passed an inverse quantizer 

25 (Q- 1 ) 100 and an inverse discrete cosine transformer (DCT 1 ) 110 according to the 
blocking information and ringing information generated by the intra filtering 
information generator 130 and the inter filtering information generator 140, 

Meanwhile, a signal adaptive filtering method according to a preferred 
embodiment of the present invention will be described. FIG. 2 is a flowchart 

30 illustrating the signal adaptive filtering method according to the present invention. 
Bitstream image data coded by an encoder is decoded by a decoder to be 
reproduced. To end this, the bitstream data is deconstructed and then inverse- 



10 



15 



quantized by. the inverse quantizer 100 (step 200). Here, the image data is 
constituted of a plurality of frames, and each frame is constituted of a plurality of 
blocks. FIG. 3 shows an inverse-quantized block having 8x8 pixels which form 
the frame. 

Before filtering the frame data with the inverse discrete cosine transform 
(IDCT), a flag is checked in order to make a determination as to whether or not the 
frame is an intraframe or an interframe (step 210). If the frame is an intraframe 
(step 220), information used to filter the intraframe is generated (step 230). If the 
frame is an interframe, information used to filter the interframe is generated (step 
240). Then, the frame data which has passed through the IDCT 110 are adaptively 
filtered according to the generated filtering information, thereby eliminating 
blocking effect and ringing noise (step 250). 

FIG. 4 is a flowchart illustrating in detail the step of generating information 
used to filter the intraframe. As shown in FIG. 4, if the frame is determined as an 
intraframe by the mode flag checking unit 120, the coefficient of pixel A of FIG. 
3 is checked (step 400). If only the coefficient of the pixel A is not equal to "0", 
horizontal blocking information (HBI) and vertical blocking information (VBI) are 
set to "1" (step 410). If any coefficient of pixels (8 pixels including the pixels A 
and B) belonging to the upper boundary region 300 of the block shown in FIG. 3 
20 is not equal to "0" (step 420), the VBI is set to "1" (step 430). Otherwise, the VBI 
is set to "0" (seep 440). Also, if any coefficient of pixels (8 pixels including the 
pixels A and C) belonging to the left boundary region 310 of the block shown in 
FIG. 3 is not equal to "0" (step 450), the HBI is set to "1" (step 460). Otherwise, 
the HBI is set to "0" (seep 470). 
25 After the HBI and VBI are set, ringing information (RI) used to filter the 

ringing noise is generated. That is, if any coefficient of pixels other than the pixels 
A, B and C of the block shown in FIG. 3 is not equal to "0" (step 480), the RI is 
set to "1" (step 490). Otherwise, the RI is set to "0" (step 495). Here, the HBI 
and VBI are set to "1" when only the coefficient of the pixel A is not equal to "0" 
30 (step 400). However, by setting the HBI and VBI to "1 " even if all coefficients of 
the pixels A, B and C are not equal to "0", favorable effect to some extent can be 
obtained when a signal adaptive filtering is performed later. 



8 

FIG. 5, is a flowchart illustrating the step of generating information used to 
filter the interframe. If the frame is determined as an interframe by the mode flag 
checking unit 120, the HBI, VBI and RI of the intraframe are transferred to HBI, 
VBI and RI of the interframe according to the motion vector (step 500). Also, if 
5 a residual signal exists after motion compensation (step 510), the RI is updated 
(step 520). 

When the blocking information and ringing information for filtering are 
generated as described above, filtering is adaptively performed according to the 
information. First, a filtering method for reducing blocking effect will be 

10 described. The filtering for reducing the blocking effect is classified as one of 
horizontal filtering and vertical filtering. Here, the horizontal filtering will be 
explained. FIG. 6 shows the location of pixels adjacent to the block boundary, for 
illustrating the filtering for reducing the blocking effect. A determination is made 
as to whether or not the HBI and RI of blocks I and J of FIG. 6 are equal to "0". 

15 If the HBI and RI of blocks I and J of FIG. 6 are equal to "0" , a weighted filtering 
is performed on pixels A, B, C, D, E and F of FIG. 6 using a 7-tap (1,1,1,2,1,1,1) 
low-pass filter (LPF). 

If the HBI or the RI of blocks I and J of FIG. 6 is not equal to "0", a 
filtering is performed on the pixels B, C, D and E using the following algorithm. 

20 

d = D - C; 

If (ABS(d ( ) < Q) { 

D= D - (d/2); C = C + (d/2); 
d = E - D; 

25 if (ABS(d) < Q ) E = E - (d/4); 

d = C - B; 

if (ABS(d) <£ Q) B = B + (d/4); 

} 

else { 

30 if (ABS(d/2) <£ 2Q) 

lf(d>0){ 

D = D - (Q - ABS(d/2)); 



C = C + (Q - ABS(d/2)); 

} 

else { 

D = D + (Q - ABS(d/2)); 
5 C = C + (Q - ABS(d/2)); 

} 

d = E - D; 

if (ABS(d) < Q) E = E — (d/4); 
d = C - B; 

10 if (ABS(d) < Q) B = B - (d/4); 
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} 



} 



In the above algorithm, ABS represents an absolute value, and Q represents 
a dividend used when the blocks forming the frame are quantized. 
15 In detail, the absolute value (ABS(d)) of the difference (d) between the 

pixels D and C is equal to or less than Q, the current pixel value of the pixel D is 
set by subtracting d/2 from the current pixel value, and the current pixel value of 
the pixel C is set by adding d/2 to the current pixel value. Also, the absolute value 
(ABS(d)) of the difference (d) between the pixels E and D is equal to or less than 
Q, the current pixel value of the pixels is set by subtracting d/4 from the current 
pixel value. Also, if me absolute value (ABS(d)) of the difference (d) between the 
pixels C and B is equal to or less than Q, the current pixel values of the pixel B is 
,set by subtracting d/4 from the current pixel value. In the same manner as the 
above, the pixel values of the pixels B, C, D and E are set according to the 
25 algorithm other than the above, which is obvious to those skilled in the art, thus the 
explanation thereof will be omitted. Also, vertical filtering is performed according 
to the same principle as the horizontal filtering. 

Next, a filtering method for reducing ringing noise will be described. First, 
the generated ringing information is checked. If the ringing information is set to 
"1", the filtering is performed. Otherwise, the filtering is not perfoimed. To end 
this, edge pixels of the block which have been subjected to inverse quantization and 
IDCT are determined. In order to determine the edge pixels, a gradient operation 
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is performed on the blocks which have been subjected to inverse quantization and 
IDCT using one-dimensional horizontal and vertical gradient operators. 

Then, an absolute value of the difference between one gradient-operated 
ptxel value and the adjacent pixel value, and Q value used as a dividend when 
5 quantizing the block, are used to generate a binary edge map representing the edge 
of each pixel. Here, the block has 8 x 8 pixels, and the s*e of the binary edge map 
» represented as a two-dimensional array edge[10][10] as shown in FIG. 7 

In order to generate the binary edge map, vertical edge detection and 
honzontal edge detection are performed. Algorithms for vertical edge and 
10 honzontal edge detections are as follows. 

/* Vertical edge detection */ 
Al = ABS(PtrImage[0] - Ptrlmagefl]); 
A2 = (ABS(PtrImage[0] - Ptrlmage[-1]) ; 
15 if (((Al > Th)&&(A2 > Th)) | j (Al > 5*Th/2) | | (A2) > 5*Th/2)) 
Edge[m][n] = 1; / * edge */ 

else { /* Horizontal edge detection */ 

A'l = ABS(PtrImage[0] - Ptrlmage[width]) ; 
A'2 = (ABS(PtrImage[0] - Ptrlmage[ -width]); 

if(((A'1>Th)&&(A'2>Th))|J(A'1>5*Th/2)||(A'2)>5*Th/2)) 
Edge[m][n] = 1; / * edge */ 

} 

4 

For the vertical edge detection, an absolute value (Al) of the difference 
25 between the gradient-operated results of the pixel (Ptrlmage[0]) on which a 
determination as to whether or not the pixel is an edge of the block is made, and 
the right pixel (Ptrimagep]) of the pixel (Pt r lmage[0]) is calculated. Then an 
absolute value (A2) of the difference between the gradient-operated results of the 
PtrlmagefO] and the left pixel (Ptrlmagef-l]) of the pixel (PtrlmagefO]) is 
30 calculated. Then, a determination as to whether or not the pixel is an edge is made 
accordmg to the logic values obtained after the absolute values Al and A2 are 
compared with a predetermined threshold value Th, and then the above process is 
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performed on all pixels of the block. The vertical edge detection is performed 
according to a logical formula of (Al > Th)&&(A2 > Th) | |(A1 >5*Th/2)| | 
, (A2)>5*Th/2). If the logical formula is true, the pixel is determined as a vertical 

edge. Otherwise, the pixel is determined to not be a vertical edge. 
5 The horizontal edge detection is performed according to the same principle 

of the horizontal edge detection. First, an absolute value (A' 1) of the difference 
between the gradient-operated results of the pixel (PtrImage[0]) on which a 
determination as to whether or not the pixel is edge of the block is made, and the 
lower pixel (PtrlmagefwidthJ) of the pixel (PtrImage[0]) is calculated. Then, an 
10 absolute value (A'2) of the difference between the gradient-operated results of the 
pixel (PtrImage[0]) and the upper pixel (Ptrlmage[- width]) of the pixel 
(PtrlmagefO]) is calculated. Then, a determination as to whether or not the pixel 
is an edge is made according to the logic values obtained after the absolute values 
A'l and A'2 are compared with a predetermined threshold value Th, and then the 
15 above process is performed on all pixels of the block. The horizontal edge 
detection is performed according to a logical formula of 
(A'l>Th)&&(A'2>Th)| |(A'l>5*Th/2)| |(A'2)>5*Th/2). If the logical formula 
is true, the pixel is determined as a horizontal edge. Otherwise, the pixel is 
determined to not be a horizontal edge. Here, '&&' represents logical AND, and 
20 '||' represents logical OR. 

Next, filtering is performed by applying a predetermined filter window to 
the generated binary edge map. The filtering may be performed by a general 
filtering method by applying a filter window having a predetermined size. 
However, in this embodiment, filtering is not performed if the central pixel of the 

25 filter window is an edge, while the filtering is performed if the central pixel is not 
an edge. The filter window may be a general filter window. In this embodiment, 
a 4-connectivity filter window having five pixels arranged in a cross shape 
centering one central pixel, as shown in FIG. 7, is used. In FIG. 7, X represents 
an edge pixel, and the regions other than the regions with "X" represent non-edge 

30 pixels. 

Also, if the filter window has no edge pixel, ordinary filtering is performed, 
while weighted filtering is performed if the edge pixel exists. An example of 



weighted filtering is shown in FIG. 7. In FIG. 7, "< < " represents a shift to the 
left, and " > > " represents a shift to the right. 

The invention may be embodied in a general purpose digital computer that 
is running a program from a computer usable medium, including but not limited to 
storage media such as magnetic storage media (e.g., ROM's, floppy disks, hard 
disks, etc.), optically readable media (e.g., CD-ROMs, DVDs, etc.) and carrier 
waves (e.g., transmissions over the Internet). Hence, the present invention may 
be embodied as a computer usable medium having a computer readable program 
code unit embodied therein for signal adaptive filtering, the computer readable 
program code means in the computer usable medium comprising; computer 
readable program code means for causing a computer to effect generating blocking 
information for reducing the blocking effect and ringing information for reducing 
the ringing noise, from coefficients of predetermined pixels of the upper and left 
boundary regions of the data block when a frame obtained by deconstructing a 
bitstream image data for inverse quantization is an intraframe; computer readable 
program code means for causing a computer to effect setting the blocking 
information and ringing information of the previous frame corresponding to a 
motion vector as blocking information and ringing information of the current frame 
if the frame is an interframe, and setting the ringing information to "1" which 
represents the image data requiring filtering if a residual signal of the inverse- 
quantized current block exists; and computer readable program code means for 
causing a computer to effect adaptively filtering the image data passed through the 
inverse quantization and inverse discrete cosine transform based on the block 
according to the generated blocking information and ringing information, for 
instance. A functional program, code and code segments, used to implement the 
present invention can be derived by a skilled computer programmer from the 
description of the invention contained herein. 

Industrial Applicability 

As described above, the present invention can remove the blocking noise 
and the ringing noise from an image restored from an image compressed based on 
blocks, thereby enhancing the image restored from compression. 



